Adaptive Assessments

#1

Adaptive Assessments

Introduction

Infosec IQ offers 9 Adaptive Assessments for each one of the Security Awareness Core Behaviors. Unlike standard assessments, which deliver the same set of questions to every learner, Adaptive Assessments adjust based on the employee’s performance on each question. These questions were developed based on the Item Response Theory to get a better understanding of how well their learners understand each of the Security Awareness Core Behaviors.

Item Response Theory

Item Response Theory (IRT) is a way to analyze responses to tests or questionnaires with the goal of improving measurement accuracy and reliability. The IRT takes into account the number of questions answered correctly and the difficulty of the question.

How they work

Each Adaptive Assessment has over 200 questions that have been seeded by their difficulty level, however, each learner will only be presented with 20 of those questions. If they get the answer right, they will be presented with a more difficult question. If they get the answer wrong, they are presented with an easier question. At the end of the assessment, they will be assigned a skill level of either novice, intermediate, or expert.

Adding an Adaptive Assessment to a Course

The below steps will walk an admin through how to add an adaptive assessment to a course:
  1. If you are modifying an existing course, click the edit pencil on the course you wish to add it to. After you click edit, this will take you to the Content Library where you can add the Adaptive Assessment to the course builder. If you are creating a course from scratch, navigate to the Content Library.
  2. Once in the Content Library, enter “Adaptive” into the search bar.
  3. The search results should show the 9 Adaptive Assessments we have available in Infosec IQ.
  4. Locate the Adaptive Assessment you would like to include, and click the + sign.
  5. The Adaptive Assessment will now be visible in the course builder section on the left-hand side of the screen.
  6. Once your course has all of the decided content, click save course
  7. After your course has been saved, you are ready to launch the campaign. If you are not familiar with how to launch an AwareEd campaign, please visit the AwareEd Campaigns page in our knowledge base.

Reporting

Data Browser
An Admin can also build a Data Browser report that shows each person’s score for that Adaptive Assessment. To do this:

  1. Navigate to the Reports drop-down menu and select Data Browser
  2. Select New Report
  3. Provide a Name for your report and select Learners as the primary object. Click Next Step.
  4. Select Timeline as the related object and click Next Step.
  5. Inside the Report Wizard, select the following fields:
    • First Name
    • Last Name
    • Email
    • (Optional) Select any other attributes that you would like to include in your report
    • Campaign Name
    • Assessment Name
    • Assessment Type
    • Assessment Score
    • Timeline Event
    • Timeline Event Timestamp
  6. Navigate back up to the top and locate the Filters section. Apply the below filter:
    • Field: Timeline Event
    • Operator: Equals
    • Values: Adaptive Assessment Completed
  7. Click the + to add the filter
  8. (Optional) An admin can also filter on a certain campaign by adding the campaign name as a filter
  9. Once you are happy with the report, click Create Report
  10. This report will show you each learner and their specific percentage score for each adaptive assessment. An admin can also download this report by clicking Download as CSV